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DATA PROCESS XNG S^^SOIXIM AND METHOD 

Field of the Invention 

5 The present invention relates in general to a data 

processing method and system. 

Background to the Invention 

10 In general terms, it is desired to assemble many small 

sections of raw audio and video content (i.e. sound clips 
and video clips) to form a finished audiovisual product/ 
by way of an authoring proceed- However, in many 
environments^ a considerable degree of specialist knowledge 

15 and time • must be invested in the authoring process in 
order to achieve a desirable finished audiovisual product i. 
These problems are exacerbated where the audiovisual 
product has a complex navigational structure or requires 
many separate ^raw content objects - 

20 

As a simple exaxaple, a feature movie or television 
program typically has a straightforward linear 
navigational sequence of individual scenes. By contrast, 
it is now desired to develop new categories of audiovisual 
25 products which have a much more complex navigational 
structure, such as a movie with many scene choices or 
different movie endings, and/or which have a large number 
of individual scenes, such as an ir^teractive quiz game 
with say one thousand individual quiz questions. 

30 

An optical disc is a convenient storage media for many 
different purposes. A digital versatile disc <DVD) has 
been developed with a capacity of up to 4 -7Gb on a single- 
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sided single-layer disc^ and up to 17Gb on a double-sided 
double-layer disc. There are presently several different 
lorniats for" recording data onto a DVu Cilscj^ iiiuludiiiy DVD— 
video, DVO~&udio^ and DVD RAM, amongst others. Of these/ 
5 DVD-video is particularly intended fox use with 
pre-recorded video content r such, as a motion picture- As 
a result o£ the large storage capacity and ease of use, 
DVD discs are becoming popular and commercially important* 
Conveniently, a DVD-video disc is played using a dedicated 
10 playback device with relatively simple user controls r and 
DVD players for playing DVD-video discs are becoming 
relatively widespread. More detailed background 
information concerning the DVD-video specification is 
available from DVD Forum at www ■ dvdf omm , or cr , 

15 

Although DVD-video discs and DVD-video players axe 
becoming popular and widespread, at present only a limited 
range of content has been developed- In particular, a 
problem arises in that, although the DVD specification is 

20 very flexible, it is also very complex. The process of 
authoring content into a DVD-video compatible format is 
relatively expensive aj;d time consuming. In practice / the 
flexibility and functions allowed in the DVD-video 
specification are compromised by the expensive and time 

25 consuming authoring task. Consequently, current DVD-video 
discs are relatively simple in their navigational 
complexity- Such simplicity can impede a user's enjoyment 
of a DVD-video disc, and also inhibits the development of 
new categories of DVD-video products. 

30 

An example DVD authoring tool is disclosed in 
WO 99/38098 (Spruce Technologies) which provides an 
interactive graphical authoring interface and data 
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management engine. This known authoring tool requires a 
relatively knowledgeable and experienced operator and 
encounters difficulties when attempting to develop an 
audiovisual product having a complex navigational 
5 structure. In particular, despite providing a graphical 
u^er interface^ the navigational structure of the desired 
DVD-video product must be explicitly defined by the 
author. Hence, creating a DVD-video product with a complex 
navigational structure is expensive, time-consuming and 
10 error-prone. 

DVDs represent one of the fastest growing forms of 
inultimedia enterta±y;ment throughout the world- 
Conventionally, DVDs have been used to present mgvies to 
15 users using extremely high quality digital audio/visual 
content- Figure 14 shows, schematically, a typical home 
entertainment system 1400 comprising a DVD player 1402, a 
DVD 1404 and a television 1406. The DVD 1404 contains a 
number of programs or cells 1408 each, of which comprises 
20 corresponding digital audio-^visual content 1410 together 
with respective navigation data 1412. The navigation data 
1412 is used by a navigation engine 1414 within the DVD 
player 1402 to control the order or manner of presentation 
of the digital content 1410 by a presentation engine 1416. 
25 The presentation engine 1416 presents the digital content 
1410 on the television 1406 as rendered audio-visual 
content 1418- • As is well known within the art, the 
rendered audio-visual content 1418 conventionally, takes 
the form a movie or photographic stills or text associated 
30 with that movie; so-called Bonus features. 

A user (not shown) can use a remote, control 1420 
associated with the DVD player 1402 to influence the 
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operation of the navigation engine 1414 via an infrared 
remote control .interface 1422. The combination of the 

't ._t^ -^.-*^^.'*^^ri. ..v.^TV^*-^•♦»,.=^ y^rt^ M-.'^.'J. ')..A.'7.f\ -J3_irv<r3. +uVk.jak. t^_» tt' .-t r^_3 +■ ■? .w!n.'n.*v 4. .in.*. 

A AX ^ U4 ^ SA ^ -WAkLW WS^**h-^w^ -k- -K A- MAikVul. ■«-«■ •*--^V*- ■ ^SjJ^W^WAX W*^^^**W 

1414 allows the user to make various selections from any 
5 menus presented by the presentation engine 116 under the 
control of the navigation engine 1414 as mentioned above 

Figure 15 shows^ schematicallyi. a pair 1500 of text 
screen stills that may represent text that can be stepped 
through by the user using their remote control 1420. 

10 Typically^ the screens stills would be* merely two such'> 
stills or a number of stills. It can be appreciated that 
the first screen still 1502 comprises a number of lines of 
text 1504 together with forwards 1506 and backwards 1509 
menu or arrow options- The forwards 1506 and backwards 

15 1508 arrow or menu options allow the user^ using their 
infrared remote control 1420^ to move to the previous text 
screen still or to the next text screen still- In the 
illustrated example, a second screen still 1504 is 
displayed in response to the user selecting the forwards 

20 arrow 1506 menu option. It can be appreciated that the 
second screen still also contains a body of text 1510 and 
forwards 1512 and backwards 1514 arrow menu options. 

Due to the relatively limited set of commands that 
might form the navigation data, the processing performed 

25 by the DVD player andr in particular, the navigation 
engine 1414/ is relatively simple and largely limited to 
responding to- infrared remote control commands and 
retrieving and displaying, via the presentation engine 
1416 r pre-authored or pre-determii^ed digital audio-visual 

30 content 1410 ► Beyond decoding and presenting the digital 
audio-visual content 1410 as rendered A/V content 1418, 
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5 

the DVD player 1402 performs relatively- little real-time 
processing. 

This can be contrasted with the relatively 
sophisticated real-time processing performed by computers 
5 when presenting^ for example, text documents such as those 
produced using Word available from Microsoft Corporation. 
Figure 16 depicts, schematically, a display process 1600 
for displaying part 1602 of a Word document 1608 on a 
screen 1604 of a computer system (not shown) . The screen 

10 1604 conventionally also contains a scroll bar 1606 that 
can be used to di$play other part? Of the global Word 
document 1608. The part 1602 of the Word document 
currently displayed is determined by a "Vindow*" 1610 that 
is capable of traversing the global word document 1608 to 

15 display various portions of that document 1608 which are 
currently of interest to a user. The processing necessary 
for such scrolling through the text 1612 of the document 
1608 is performed in r$al-time- Effectively^ the 

microprocessor of the computer together with its 

20 instruction set is sufficiently sophisticated and flexible 
to imbue the Word application (not shown) with the 
capability to perform the necessary calculations and 
manipulations to implement scrolling through the Word 
document 1606- It will be appreciated tha.t each time the 

25 user scrolls to a different section of the global Word 
document 1608^ the part of the word document 1602 shown on 
the screen 1604 is updated^, in real-time, in response to 
any scroll coroiriands issued by the user. 

It will be appreciated that this is in stark contrast 
30 to the display of text information via the DVD plainer 1402 
and the relatively crude or unsophisticated manner of 
stepping through that information as shown in figure 15. 
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Current DVD players are unable to perform the real-time 
processing necessary to realise scrolling of data or 
images in a manner that la? a'xiuilai; 'to "thatu prcrf-o-riTi^d by 
computers primarily due to the very limited instruction 
5 set that forms the navigation data and that controls the 
presentation engine. 

It is an object of embodiments of the present 
invention at least to mitigate some of the problems of the 
prior art. 

ID Summary of Invention 

In a first aspect of the present invention there is 
provided an authoring method for use in creating an 
audiovisual product , comprising the steps of: defining a 

15 plurality of components/ the components implicitly • 
representing functional sections of audiovisual content 
with respect to one or more raw content objects^ and a 
plurality of transitions that represent movements between 
the plurality of components/ expanding the plurality of 

20 components and the plurality of transitions to provide a 
set of explicitly realised AV assets and an expanded, 
intermediate data structure of nodes and links ^ where each 
node is associated with an AV asset of the set and the 
links represent movement from one node to another,- and 
25 creating an audiovisual product in a predetermined output 
format, using the AV assets and the expanded intermediate, 
data structure of the nodes and the links r wherein the 
audiovisual product comprises data representing at least a 
set of data for producing, or at least emulating r 

30 scrolling image data. 




I 
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In on© preferred embodiment, the present invention 
relates to authoring of audiovisual content into a form 
compliant with a specification for DVD-video and able to 
be recorded on an optical disc recording medium. 

5 

In a second aspect of the present invention there is 
provided an authoring method for use in creating a DVD- 
video product, comprising the steps of: creating a 
plurality of components representing parameterlsed 

10 sections of audiovisual content, and a plurality of 
transitions representing movements between components; 
expanding the plurality of components and the plurality of 
transitions to provide a set of AV assets and an expanded 
data structure of nodes and links, where each node is 

15 associated with an AV asset of the set and the links 
represent movement from one node to another; and creating 
a DVD-video format data structure from the AV assets, 
using the nodes and links, wherein the DVD-video format 
data comprises data representing, or at least emulating, 

20 scrolling image data- 
in a third aspect of the present invention there is 
provided an authoring method for use in creating an 
audiovisual product according to a DVD-video 

25 specification^ comprising the steps of: generating a set 
of AV assets each comprising a video object, zero or more 
audio objects and serO or more sub-picture objects, and an 
expanded data structure of xiodes and links, where each 
node is associated with one AV asset of the set and the. 

30 links represent navigational movement from one node to 
another; and creating a DVD-video format data structure 
from the set of AV ^issets, using the nodes and links; the 
method characterised by the steps of: creating a plurality 



I 
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of components and a plurality of transitions^ where a 
component implicitly defines a plurality of AV assets by 
p^jQQX'ring to pz^stsTits*uiijiii t^uiplatc Ginrd. to ^ztsms of -rav7 
content substitutable in the presentation template, and 
5 the plurality of transitions represent navigational 
movements between components; and expanding the plurality 
of components and the plurality of transitions to generate 
the set of AV assets and the expanded data structure of 
nodes and links, wherein the " set of AV assets and the 
10 expanded data structure comprise scrolling image data. 

In another aspect the present invention there is'^' 
provided a recording medium having recorded thereon 
computer implemenfcable instructions for- performing any of 
15 the methods defined herein - 

In yet another aspect of the present invention there 
is provided a recording medium having recorded thereon an 
audiovisual product authored according to any of the 
20 methods defined herein. 

Advantageously, embodiments can provide a convenient 
and simple method and apparatus for authoring an audio- 
visual product - 

25 

Preferred embodiments provide a method and apparatus 
able to create an audio-visual product having a complex 
navigational structure and/or having many individual 
content object^/ whilst reducing a time required for 
30 authoring and minimising a need for highly skilled 
operators - 
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Preferably, ther^ is provided an authoring tool that 
is intuitive to use and is highly flexible - 

Particularly preferred embodiments support creation of 
S audio-visual products such as DVD-video products that run 
on commonly available DVD-video players . 

Accordingly ,r A first aspect of embodiments of the 
present invention provides a data processing method for 
10 authoring optical medium data; the method comprising the 
step of: 

producing, from data representing a static visual 
asset, a set of visual assets in which each visual asset 
of the set comprises data unique to that asset and data 
15 common to that asset and at least one other visual asset 
of the set; each visual asset of the S6t having respective 
defined dimensions . 

Advantageously^ embodiments of the present invention 
20 allow scrolling of image data by a DVD player to be 
realised, that is^. the embodiments allow the real-time 
scrolling performed by computers to be emulated at least. 

Bri^f Description of the Drawings 

25 Embodiments • of the present invention will now be 

described, by way of example only, with reference to the 

accompanying drawings in which: 

Figure 1 is an overview of an authoring method 

according to a preferred embodiment; 
30 rigure 2 is a schematic diagram showing a simple 

abstraction of a desired audiovisual product; 
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Figure 3 shows in more detail a component used as part 
of the abstraction of Figure 2; 

Figure 4 illua"trercca" au eXciitLijie pxior cTlTu utrthwiiTiy 
method compared with en example preferred embodiment; 
S Figure 5 depicts another example embodiment of the 

present authoring method using components and transitions; 

Figure 6 shows the example of Figure 5 in a tabular 
format; 

Figure 7 is an overview of a method for evaluating 
10 components and transitions; 

Figure 8 depicts evaluation of components in more 
detail ; 

Figure 9 shows evaluation of transitions in more 
detail; 

15 Figure 10 illustrates a portion of an expanded data 

structure during evaluation of components and transitions; 

Figure ll is an overview of a preferred method for 
creating DVD-video structures from an expanded data 
structure; 

20 ' Figure 12 shows a step of creating DVD video structure 

locations in more detail; 

Figure 13 depicts a step of creating DVD-video 
compatible data structures ±n more detail; 

Figure 14 shows a home entertainment system; 

25 Figure 15 shows a pair of text screens; 

Figure 16 illustrates relatively sophisticated 
scrolling performed by a computer; 

Figure 1"? shows^ schematically, authoring of scrolling 
data sets according to an enibodiment ; 

30 Figure 18 illustrates the display of a number of 

scrolling data sets according to an embodiment; 
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Figure 19 illustrates a flowchart for producing 
scrolling data sets? 

Figure 20 shows a flowchart for displaying digital AV 
content using scrolling data sets; and 

.5 . Figure . 21 illustrates . two-dimensional scrolling and 
the production of two-dimensional scrolling data sets- 

Detailed Description of the Preferred Embodiments 

10 Figure 1 shows an' overview of an authoring method 

according to a preferred embodiment of the present 
invention. The embodiments of the present invention are 
applicable when authoring many types of audiovisual 
content or products, and in particular when complex 

15 navigational structure or content are involved. 

As one example f embodiments of the present invention 
are applicable to authoring of video-on-demand products 
delivered remotely from a service provider to a user^ such 
20 as over a computer network or other telecommunications 
network. Here^ the embodiments of present invention are 
especially useful in authoring. interactive products^ where 
user choices and responses during playback of the product 
dictate navigational flow or content choices. 

25 

As another example ^ embodiments of the present 
invention are particularly suitable for use in the 
authorini? bf an audiovisual product or audio visual 
content compliant with a DVD-video specification. This 
30 example will be discussed in more detail below in order to 
illustrate the preferred arrangements of present 
invention* The audiovisual product can be, for example, 
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recorded onto a medium such as an optical disk or magnetic 
medium. The DVD-video specification defines a series of 
data ojarj"eT;'irs "•uiTart- are arranged in a hierarchical 
structure, with strict limits on the maximum number of 
5 objects that exist at each level of the hierarchy. Hence,, 
in one preferred ernbodiment of the present invention it is 
desired to create an audiovisual product or audiovisual 
content which meets these and other limitations of the 
specification- In particular it is desired that the 

10 resultant audiovisual product will" play on commonly 
available DVO players. However/ it is also desired to 
create the audiovisual product having a complex 
navigational structure,, to increase a user's enjoyirient of 
the product^ and in order to allow ..the creation of new 

15 categories of audiovisual products . 

In the field of DVD-video, audiovisual content is 
considered in terms of audio-visual assets (also called AV 
assets or presentation objects). According to the DVD- 

20 video specification each AV asset contains at least one 
video object, zero or more audio objects, and zero or more 
sub-picture objects. That is, a section of video data is 
presented along with synchronised audio tracks and 
optional sub-picture objects. The current DVD-video 

25 specification allows up to eight different audio tracks 
(audio streams) to be provided in association with up to 
nine video objects (video streams) . Typically, the video 
streams represent different camera angles, whilst the 
audio streams represent different language versions of a 

30 soundtrack such as English, French^ Arabic etc. Usually, 
only one of the available video and audio streams is 
selected and reproduced when the DVD-video product is 
played back. Similarly, the current specification allows 
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up" to thirty- two sub-picture streams, which are used for 
functions 5uch as such as language subtitles. Again^ 
typically only one of the sub-picture streams is selected 
and played back to give,- for example^ a movie video clip 
5 with English subtitles from the sub-picture stream 
reproduced in combination with a French audio stream. Even 
this relatively simple comhinstion of video, audio and 
sub-picture streams requires a high degree of co- 
ordination and effort during authoring to achieve a 

10 finished product such as a feature movie. Hence, due to 
the laborious and expensive nature of the authorincr 
process there is a strong disincentive that inhibits the 
development of high-quality audiovisual product according 
to the. DVD-video specification. There is then an even 

15 stronger impediment against the development of audiovisual 
product with complex navigational flow or using high 
numbers of individual raw content objects. 

Conveniently, the authoring methods of embodiments of 
20 the present invention are implemented as a program or a- 
suite of program-s. The program or programs are recorded or 
stored on or in any suitable medium, including a removable 
storage such as a magnetic disk, hard disk- or solid state 
m:emary card, or as a signal modulated onto a carrier for 
25 transmission on any suitable data network, such as the 
Internet. 

Xn use, the authoring method is suitably performed on 
a computing platform, like a general purpose computing 
30 platform such as a personal computer or a client-server 
computing network. Alternatively, the method may be 
implemented, wholly or at least in part, by dedicated 
authoring hardware. 



NOV. 2003 1 7:54 HARRISON GODDARD FOO NO. 996 P. 20 



14 



A3 shown iji Figure 1, the authoring method of the 

three main stages, namely: creating a high-level 
5 . abstraction (or storyboard) representing functional 
sections of a desired audiovisual product in step 101; 
automatically evaluating the high-level abstraction to 
create a fully expanded intermediate structure and a set 
of AV assets in step 102; and creating an output data 

10 structure compliant with a DVD-^video specification using 
the expanded intermediate structure and AV assets in step 
103. Preferably I- the output data structure can then 
recorded onto a recording medium^ such as, for example, a 
digital linear tape that can be used,, to create a DVD- 

15 video product using glass master created using the content 
of the digital linear tape. 

The method outlined in Figure 1 will now be explained 
in more detail. 

20 . 

Firstly, looking at the step 101 of Figure. 1^ the 
high-level abstraction is created by forming a plurality 
of components that implicitly represent functional 
elements of a desired DVD-video product, and a set of 
25 transitions that represent movements <- that ±s, navigation, 
between the components that will occur during playback. 

Figure 2 is a schematic diagram showing a simple 
abstraction of a desired audiovisual product- In the 
30 example of Figure 2 there are three components 201, linked 
by two transitions 202. The components 201* represent 
functional elements of the desired audiovisual product,, 
where one or more portions of AV content (combinations of 
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vid^o clips/ audio clips ^ etc) are to be reproduced during 
playback. The transitions 202 indicate legitimate ways of 
moving from one component to another during playback- In 
the example of Figure 2, the transitions 202 are all 
5 explicitly defined. .Suitably^ each transition 202 is 
associated with an event 203 ^ which indicates the 
circumstances giving rise to that transition. An event 
203 is a triggering action such as the receipt of a user 
command, or the expiry of a timer, that influences 

10 movement through the . sections of AV content during 
playback. Referring to Figure 2, starting from a 
particular component A, and given all possible actions ^ 
exactly one event 203 will be satisfied, allowing a 
transition 202 from the current component A to a next 

15 component B or C. 

The preferred embodiments provide three different 
types of cottiponent. These are an information component, a 
choice component and a meta-component - 

20 

An information component represents what will in due 
course become a single AV asset in the desired audiovisual 
product. Suitably r an information component simply 
comprises a reference to a raw content object or 

25 collection of raw content objects (i.e. raw video and 
audio clips, image stills or other digital content) that 
will be used to create an AV asset in th$ audiovisual 
product. For example^ an information component refers to 
a welcome sequence that is displayed when the DVD-video 

30 product is played in a DVD-video player- The same welcome 
sequence is to be played each time playback begins- It is 
desired to display the welcome sequence, and then proceed 
to the next component. An information component (which 
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can alsQ be termed a simple component) is used principally 
to define presentation data in the desired DVD-video 

5 A choice component represents what will become a 

plurality of AV assets in the desired audiovisual product. 
In the preferred embodiment, the choice component 
(alternately temed a multi-component) comprises a 
reference to at least one raw content object,, and one or 

10 more parameters. Here^ for example, it is desired to 
present a welcome sequence in one of a plurality of 
languages, dependent upon a language parameter » That is, 
both a speaker's picture (video stream) and voice track 
(audio stream) are changed according to the desired 

15 playback language. Conveniently/ a choice component is 
used to represent a set of desired AV assets in the 
eventual audiovisual product, where a value of one or more 
parameters is used to distinguish between each member of 
the set. Hence a choice component represents mainly 

20 presentation data in a desired DVD-video product, but also 
represents some navigational structure (i.e» selecting 
amongst different available AV assets according to a 
language playback parameter) . 

25 A meta-component comprises a procedurally-def ined 

structure representing a set of information components 
and/or a set of choice components, and associated 
transitions. Conveniently^ a meta-component may itself 
define subsidiary meta-components, A meta-component is 

30 used principally to define navigational structure in the 
desired audiovisual product by representing other 
components and transitions. 
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Figuxre 3 showra a choice component or information 
contponent 201 in more detail • The component is reached by 
following one of a set of incoming transitions 202, 
labelled Ti(l.-n), and is left by following one of a set of 
5 outgoing transitions To(l..jn>. The set of incoming 
transitions 202 might comprise one or more than one 
incoming transition. The set of outgoing transitions 
might comprise one or more than one outgoing transition. 




10 The comj^onent 201 is defined with reference to zero or 

more parameters 301, which are used only during the 
authoring process. However, the component 201 may also be 
defined with reference to zero or more runtime variables 
302- Each Variable 302 records state information that can 

15 be read and modified within the scope of each component, 
during playback of the audiovisual product such as in a 
standard DVD player. Conveniently, the component 201 is 
provided with a label 303 for ease of handling during the 
authoring process. 

; 20 

The component 201 contains references to one or more 
items of content 304. The items of content are raw 
multi-media objects (still picture images, video clips, 
audio clips, text data, etc.) recorded in one or more 
25 source storage systems such as a file system, database, 
content management system, or asset management system, in 
any suitable format such aSr for exafcipiXe, .g±t, ,tif^ 
i .bmp, -txt, -rtf, -jpg/ -mpg, .qtf, .mov, .wav, . rm, -qtx, 

amongst many others. It will be appreciated that these raw 
30 content objects are not necessarily at this stage in a 
format suitable for use in the DVD-video specification, 
which demands that video, audio and sub-picture objects 
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are provided in selected predetermined formats (i.e. 
MPEG) . 

Each component 201 uses the references as ^ key or 
5 index which allows thet item of content to be retrieved 
from the source storage systems. The references may be 
eicplicit (e.g. an . explicit file ps-th) , or may be 
determined implicitly/ such as with reference to values of 
the parameters 301 and/or variables 302 (i-e- using the 
IQ parameters 301 and/or variables 302 to construct an 
explicit file path) . 

Conveniently^ the component 201 also preferably 
comprises a reference to a template 305, The template 305 
15 provides, for example, a definition of presentation, 
layout r and format of a desired section of AV content to 
be displayed on screen during playback. A template 305 
draws on one or more items of content 304 to populate the 
template. Typicallyr one template 305 is provided for 
20 each component 201. However, a single template 305 may be 
shared between a number of components 201 or vice ver3a, 
A tenplate 305 is provided in any suitable form^ such as, 
for example. As an executable program^ a plug-in or an 
active object- A template is conveniently created using a 
25 programming language such as C-i-+, Visual Basic^ Shockwave 
or Flash, or by using a script such as HTML or Python^ 
amongst many others. Hence, it Kill be appreciated that a 
template allows a high degree of flexibility in the 
creation of AV assets for a DVD-video product, Also^. 
30 templates already created for other products (such as a 
website) may be reused directly in the creation of another 
form of audiovisual product, in this case a DVD-video 
product content . 
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The pa^rameters 301, runtime variables 302 r content 
items 304 end teinplate 305 together allow one or more Av 
assets to he produced for use in the desired audiovisual 
5 prod-uct- Advantageously / creating a component 2 01 in this 
parameterised form; allows a number ,r which might be a large 
number, large plurality of AV assets to be represented 
simply and easily by a single component. 

10 To illustrate the power and advantages of creating 

components 201 and transitions 202 as described above, 
reference will now be made to Figure 4 which compares a 
typical prior art method for authoring an audiovisual 
product against preferred embodiments of the present 
13 invention. In this example, it is desired to develop an 
audiovisual product which allows the user to play a simple 
quiz game. 

In Figure 4a, each AV asset 401 which it is desired to 
20 present in the eventual audiovisual product must be 
created in advance and navigation between the assets 
defined using navigation linJcs represented by arrows 402. 
Here, the game involves - answering a first question and, if 
answered correctly, then answering a second question. The 
25 answer to each question is randomised at runtime using a 
runtime variable such that one of answers A, B and C is 
correct, whilst the. other two are incorrect. In this 
simple example of Figure 4a it can be seen that a large 
niomber of assets need to be created, with an even greater 
30 number of navigational links. Hence, the process is 
relatively expensive and time consuming, and is prone to 
errors . 
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Figua:e 4b shows an abstraction, using coitipononts and 
transitions as described herein^ for equivalent quiz 

St — — -.-^ _ w>«-.M » V MM •.^•w s— bt.«M* w wxiA laiiw^vvji 

in Figure 4b remains identical even if the number of 
5 questions increases to ten^ twenty^ fifty or some other 
number of questions, whereas the representation in Ficrure 
4a becomes increasingly complex each question is added _ 

Figure 5 shows another example abstraction using 
10 components and transitions. Figure 5 illustrates an 
exaniple abstraction for audiovisual product th^t will 
contain a catalogue of goods sold by a retail merchant. A 
welcome sequence is provided as an information component 
201a- Choice components 201b are used^ to provide a set of 
15 similar sections of AV content such as summao^y pages of 
product information or pages of detailed product 
inforirvation including photographs or moving video for each 
product in the catalogue. Here, the catalogue contains, 
for example,. of the order of one thousand separate 
20 products^ each of which will result in a separate AV asset 
in the desired DVD-video product- Meta-oomponents 201c 
provide functions such as the selection of products by 
category, name or by part code. These meta-components are 
procedurally defined. 

25 

Figure 6 shows a tabular representation for the 
abstraction shown in schematic form in Figure 5. 

In use^ the authoring method and apparatus ^suitably 
30 presents a convenient user interface for creating 
components and transitions of the high-level abstraction. 
Ideally, a graphical user interface is provided allowing 
the definition of components, tx-ansitions and events ^ 
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j similar ta the schematic diagram of Figure 5- Most. 

conveniently, the user interface provides for the 
I graphical creation of components such as by drawing bo:i£es 

and entering details associated with those boxes, and 
5 defining transitions by drawing arrows between the boxes 

and associating events with those arrows. Alternatively, a 

tabular textual interface is provided similar to the table 

of Figure 6- 

10 Referring again to Figure 1, the abstraction created 

in step 101 is itself a useful output. The created 

j abstraction may be stored for later u$e or may be 

transferred' to another party for further work- However^ in 
most cases the authoring method is used to automatically 

I . 15 create a final audiovisual product^ such as a DVD-video 

product, from the abstraction. 

j Referring to Figure 1, the method optionally includes 

the step 104 of checking for compliance with a OVD 
20 specification. It is desired to predict . whether the 
resulting DVD-video product will conform to a desired 
output specification/ in this case the DVD-video 
specification. For example^ the DVD-video specification 
has a hierarchical .structure with strict limits on a 

: 2 5 maximum number of objects that may exist at each level 

I and limits on the maximum quantity of data that can be 

' stored on a DVD-video disc. 

In one embodimentir the checking step 104 is performed 
30 using the created components 201 and transitions 202. As 
i discussed above, the components 201 contain references to 

i raw AV content objects 304 and templates 305, and 

authoring parameters 301, 302, that allow AV assets to be 
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produced. The checking step 104 comprises predicting a 
required number of objects at each level of the 

potential AV assets that will be produced given tlie 
5 possible values of the a\ithoring parameters {i.e. 
authoring-only parameters 301 and runtime variables 302), 
and providing ah indication of whether the limits for the 
maximum number of objects will be exceeded. Similarly, 
where a component defines a set of similar AV assets / then 

10 it Is useful to predict the physical size of those assets 
and to check that the audiovisual product is expected to 
fit within the available capacity of a DVD disc. 
Advantageously^ the conformance check of step 104 is 
performed without a detailed realisation of every AV 

15 asset, whilst providing an operator with a reasonably 
accurate prediction of expected conformance. , If 
non- conformance is predicted, the operator may then tafc© 
steps, at this early stage r to remedy the situation- As a 
result^ it is possible to avoid unnecessary time and 

20 expense in the preparation of a full audiovisual product 
which is non-conformant - 

As shown in Figure 1, in step 102 the components 201 
and transitions 202 of the high level abstraction 200 are 
25 automatically evaluated and expanded to create AV assets 
and an intermediate data structure of nodes and links. 
-Figure 7 .shews the. step 102 of Figure 1 in more detail . 



The coittponents 201 and transitions 202 may be 
30 evaluated in any order. Howe vex, but it is convenient to 
first evaluate the components and then to evaluate the 
transitions. Ideally, any meta-components in the 

abstraction are evaluated first- Where a met a -component 
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results in new components and transitions f these are added 
to the abstraction until all meta-components have been 
evaluated,. leaving only information components and 
parameterised choice components - 

5 

An expanded intermediate data structure is created to 
represent the abstract components 201 and transitions 202 
in the new evaluated form. This expanded data structure 
comprises branching logic derived from the events 203 

10 attached to the transitions 202 (which will eventually 
become navigation data in the desired audiovisual product) 
and nodes associated with AV assets derived froia the 
components 201 (which will eventually become presentation 
data in the audiovisual product). However, it is not 

15 intended that the expanded data structure is yet in a 
Suitable form for creating an audiovisual product in a 
restricted format such as a DVD-video product, since at 
this stage there is no mapping onto the hierarchical 
structure and other limitations of the DVD-video 

20 specification. 

Figure 6 shows step 7 01 of Figure 7 in more detail, to 
explain the preferred method for evaluating the components 
201. As shown in Figure 8, each information component 201a 

25 and each choice component 201b is selected in turn in step 
801. Each component 201 is evaluated to provide one or 
more AV assets In step 802, In an information component, 
this evaluation comprises creating an AV asset from the 
referenced raw content objects 304. In a choice component, 

30 this evaluation step comprises evaluating a template 305 
and one or more raw content objects 304 according to the 
authoring parameters 301/302 to provide . a set of AV 
assets- Suitably, a node in the expanded data structure 
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is created to reprasent each AV asset, at step 803. At 
3tep 804/ entry logic and/or exit logic is created to 

- "^r*-^ WW j_jn^ni ociL^ii iiwutt aucin tncn^ eacn av 

asset is xeached or left under appropriate runtime 
5 conditions - 

Figure 9 shows a preferred method for evaluating 
transitions in step 702 of Fig. 7. Each transition 202 is 
selected in any suitable ord^r in step 901. in step 902 
10 th© conditions of the triggering event 203 associated with 
a particular transition 202 are used to create entry 
and/or exit logic for each node of the expanded data 
structure. In step 903, explicit links are provided 
between the nodes. ; 

15 

Figure 10 is a schertiatic illustration of a component 
201 during evaluation to create a set of nodes llO each 
associated with an AV asset 120, together with entry logic 
132 and exit logic 134, defining movement between one node 

20. 110 and the next. The entry logic 132 and exit logic 134 
reference runtiitie variables 302 which are available during 
playback (e.g. timer events, player status, and playback 
states), and the receipt of user commands. Conveniently, 
the evaluation step consumes each of the authoring-only 

25 parameters 301 associated with the abstract components 
201, such that only the runtime variables 302 and rimtime 
actions such as timer events and user commands remain. 

Referring again to Figure 1, a conformance checking 
30 step 105 may, additionally or alternatively to the 
checking step 104, be applied following the evaluation 
step 102- Evaluation of the abstraction in step 102 to 
produce the expanded data structure 100 allows a more 
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accurate prediction of e5<:pected compliance with a 
particular output specification. In particular, each node 
of th6 expanded data structure represents one AV asset,, 
such that the total nuinber of AV assets and object 
5 locations can be accurately predicted, and the set of AV 
assets has been created^ allowing an accurate prediction 
of the capacity required to hold these assets. 
Conveniently, information about conformance or non- 
conformance is fed back to an operator. Changes to the 
10 structure of the product can then be suggested and made in 
the abstraction to . improve, compliance . 

Referring to Figure 1, in step 103 the expanded data 
structure from step 102 is used to create an audiovisual 
15 product according to a predetermined output format, in 
this case by creating specific structures according to a 
desired DVD-video specif ication. 

Figure ll shows an example method for creation of the 
20 DVD video structures. In step 1101^ the nodes 110 in the 
expanded data structure are placed in a li^t, such as in 
an order of the abstract components 201 from which those 
nodes originated, and in order of the proximity of those 
components to adjacent components in the abstraction. As 
25 a result, jumps between DVD video structure locations 
during playback are rainimised and localised to improve 
playback speed and cohesion. 

Each node is used to create a DVD video structure 
30 Ideation at step 1102. Optionally, at step 1103 if the 
numiber of created DVD video structure locations exceeds 
the specified liniit set by the DVD-video specification 
then creation is stopped at 1104 and an error reported. 
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Assuioing the number of structures is within the spacified 
limit then DVD video compatible data structures ar© 
created at stsp 1105. Finally?, a DVD video di^ic iTnage is 
created at step 1106. Conveniently, cotnmercially 

available tools are used to perform step 1106 and naed not 
be described in detail here. 

Step 1102 is illustrated in more detail in Figure 12. 
In this example variable T represents a nuinber of a video 
title set VTS (ie. from 1-99) whilst variable P represents 
a program chain PGC (ie. from 1-999) within each video, 
title set. As shown in Figure 12, the nodes 110 of the 
expanded data structure. 100. are uged to define locations 
in the video title sets and program chains. As the 
15 available program chains within each video title set are 
consumed, then the looationa move to the next video title 
set. Here, many alternate methods are available in order 
to optimise allocation of physical locations to the nodes 
of the expanded data structure. 



10 



Step 1105 of Figure 11 is illustrated in more detail 
in Figure 13. Figure 13 shows a preferred method for 
creating DVD-video compatible data structures by placing 
the AV assets 120 associated with each node 110 in the 
23 structure location assigned for that node and substituting 
links between the nodes with explicit references to 
destination locations. At step 1307 this results in an 
explicit DVB compatible data structure which may then be 
used to create a DVD disc image. Finally, the DVD disc 
image is used to record a DVD disc as a new audiovisual 
product . 
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Referring to figure 17 there 15 shown scheinatically an 
authoring process 1700 for producing a number of stills or 
frames 1702 to 1712 from a document 1714 intended to be 
presented by the navigation engine 114 of a DVD player 102 
5 in response to controls xeceived from the infrared remote 
control 120. It will be appreciated that the document 
represents a realisation of a raw content object described 
above. The document 1714 represents an embodiment of a 
static or original visual asset. The stills 1702 to 1712 
10 represent at least part of a set of visual assets for use' 
In producing an optical medium based product, such as, for 
example, a DVD product. A moveable window 1716 is 
arranged to traverse the document 1714, according to a 
pre-defined step size 171S, to produce each of the stills 
15 or frames 1702 to 1712. When each of the stills or frames 
1702 to ' 1712 are retrieved and presented by this 
■presentation engine 1416 they will give the impression to 
the user of the DVD player 1402 that the DVD player is' 
scrolling through the dociment 1714 in real-time even 
20 though no real-time processing comparable with that- 
undertaken by a computer is performed. The data required 
to emulate such scrolling is pre-authored or pre- 
calcuiated, that is, it is determined in advance. The' 
pre-authored data represent a realisation or raw content' 
25 bbjects- 

Within the- user interface presented by the authoring 
toolr there is a ""^ID scroll" component, which represents a 
scroll action or implementation • The ''^ID scroll" 

component would preferably be implemented as a meta-- 
30 component and would be parameterised with a file name, 
image file, some other source file or reference to source 
content that corresponds to a document or content to be 
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scroll'&d. Preferably, other parameters or aspects of the 
scroll operation would ^Iso be parameterized such as, for 
example, speed of acrollincr, percentage .of...ov:e:K'is.n -bet-veen 
consecutive scrolled sections ^tc. 

5 During the authoring process, such a meta-coraponent 

--. -representing a scrolling . operation or action would be 
expanded into many nodes and links . Each node would 
correspond tg an individual animated scrolling sequence^ 
and ths links, would connect those nodes together so that 
10 adjacent scrolling sequences are connected appropriately. 
Thus, in this expansion process, the original data, for 
example, an. ijciage file, would be used as source material 
to create A number of animated sequences, each sequence 
representing part of the overall document scroll. 

13 It will be appreciated that as the step size 1718 

decreases r the smoothness of the result in scrolling 
increases- • 

Each of the extracted stills or frames 1702 to 1712 
are used to produce corresponding scrolling data sets 1802 
20 to 1S12 as shown in figure 18. . For each scrolling data 
set 1802 to 1812, a scroll bar graphic 1802a to 1812a is 
also produced. Each scroll bar graphic 18D2a to 19i2a 
comprises up arrow menu options 1802b to 1812b and down 
arrow menu options 1802c to 18l2c that are recorded and 
25 presented as sub-picture data of the digital content 1410, 
Associated with each scrolling data set 1802 to 1812 is 
corresponding navigation data that points to a preceding 
or succeeding still or frame 1702 to 1712. The 
corresponding navigation data used to retrieve a preceding 
30 or succeeding frame is determined according to which' of 
the arrows 1802b to 1812b and 1802c to 1812c have been 
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actuated or 3elected by the user using their remote 
control 1420. The navigation data comprises a number of 
forw^ard links 1802d to iSlOd and a number of backward 
links 1812e to 1804e to allow the user to scroll through^ 
5 that is, select, the various stills 1702 to 1712- 
represented by data recorded on the DVD 14 04. It will be 
appreciated that the navigation data each represent a 
realisation of the data of the expanded intermediate 
structure of nodes and links. Once the user has reached a 

10 ^tart or end screen such as, for example, stills 1702 and 
1702 respectively, the sub-picture menu data can be 
arranged such that the stills 1702 to 1712 present a 
^^wrapped-around" document. If an embodiment intends to 
:^re5ent a '''^wrapped-around" document^ corresponding 

15 navigation data 1812d and lB02e is required. 
i.Alternatively, the sub-picture menu data can be modified 
to indicate that one can only traverse forwards and 
backwards, between the start 1702 and end 1712 stills by 
removing the backwards and forwards menu options from the 

20 start 1702 ^nd end 1712 stills respectively - 

It will be appreciated that each of the generated 
stills 1702 to 1712 represent, at least in part, 
transition data for giving effect to scrolling. 

Referring to figure 19, there is shown a flowchart 
25 1900 of the processing involved in an authoring method" 
according to an embodiment. The original asset such as, 
for exaiciple, the text docximent 1714, is stored in memory 
(not shown) at step 1902. A scroll start position, SSP, 
is defined in step 1904. For example, in one embodiment 
30 the scroll start position may correspond to the first row 
of pixels of the scrolling window 1716 when it is in a 
position that corresponds to still or frame 1702. At step 
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1906, a scroll end position SEP, la defined. Fax example, 
in the first embodiment., the scroll end position 
corresponds to the first row of nijit^.i-^i defined by the 
window 1716 when in a position corre3ponding to the last 
still or frame 1712, However, in second embodiment, the 
scroll end position might ^ correspond to the first row of 
■pixels of the window 1716 when it is in a position 
corresponding to the second still or frame 1704. The 
choice of which embodiment one skilled in the art realises 
depends upon the required scrolling smoothness or 
resolution-' . 

A scrolling step size, SSS, is defined at step 1908. 
The scrolling step size also influences the smoothness or 
resolution of any resulting scrolling. Longitudinal, 
15 .and transyerse^ visual asset dimensions are defined at 
step IdlO- The number, N, of stills or frames required to 
give effect to scrolling between the scroll start 
position, SSP, and the scroll end position^ SEP, is 
■ calculated at step 1912. Also, a count, M, that is used 
20 to keep track of the number of assets or frames produced 
so far is set to zero at step 1912. 

A test is made, at step 1914, to determine whether 
N«0. If it is deterinined that N is equal to zero, the 
visual asset creation process shown by the flowchart 1900 

25 is terminated. However, if it is determined that K is not 
equal to zero, the asset start position, ASP, and asset 
end position, AEP, are calculated at step 1916. It will 
be appreciated that the longitudinal and transverse 
dimensions effectively correspond to the dimensions of the 

30 moveable window 1715 used to produce the assets. A 
current asset to be created is produced and stored using 
the original data 1714, the asset start position, the 
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asset end position together with the window 1716 or asset 
dimensions^ H and at step 1918. Also created, at step 
1918, are the corresponding scroll bar graphics lB02a to 
1812a together with appropriate forwards navigation data 
5 1802d to 1812d and backwards navigation data 1812e to 
1802e. At step 1920 r the number, of screens or assets 

. to be created is reduced by one and the county is 
increased by one. 

It will be appreciated that the flowchart 1900 shown 
10 in figure 19 allows the data used in implementing or 
emulating the scrolling to be produced in advance and 
, automatically. These pre-authored scrolling data sets can 
be used, in the creation of a digital linear tape in 
preparation for producing the DVD product. It will be 
15 appreciated that each created asset 1702 to 1712 might be 
stored, on the resulting DVD product, as a GOP with an 
MPEG sequence code, which provides an indication to the 
* navigation 1414 and presentation engines 1416 that the 
data representing the asset should presented as a still. 

20 Referring to figure 20 there is shown a flowchart 2000 

for rendering the scrolling data sets 1002 to 1812. At 
step 2002, the initial data set or GOP, with an MPEG 
sequence code, is retrieved and rendered. Also, the 
corresponding initial sub-picture ^^menu" or scroll 

25 direction arrow graphics 1802b to 1812b and 1802c to 1812c 
are retrieved and rendered at step 2004. The navigation 
engine 1414 then awaits receipt of a control command from 
the infrared remote control 1420 at step 2005. Such a 
command is shown as having been received at step 2006 in 
30 the flow chart 2000. It is determined, at step 2008, 
whether the command is an ^^end" command. If the command 
is an "end" command the process for rendering the 
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scrolling data sets is terminated. It will be appreciated 
that within this context an ''end"' coinmand represents a 
command that indicates _^ desire to perform some prof::fas.=ii_p_g 
or activity other than continued scrolling. At step 2010, 
5 it is determined whether the command represents a 
selection of the menu item represented by a scroll-up 
arroviT and, therefore, represents actuation of the scroll^ 
up arrow 18 02b to IS 12b. If it is determined, at step 
2010, that the scroll-up arrow has been actuated/ the 

10 navigation engine 1414^ using the appropriate navigation 
data 2012e to 2002e, retrieves the ""previous-"' or preceding 
still or frame 1702 to 1712 at step 2012. However, if it 
is determined that the scroll-up arrow has not been 
actuated^ it is assumed that the scroll^down arrow ha$ 

15 been actuated and the nex;t or succeeding still or frame 
1702 to 1712 is rotirieved and rendered at step 2014. 
Processing then returns to step 2005- 

AlthQugh the above embodijnent has been described with 
reference to calculating scrolling data sets using the 
20 pre-defined steps size 1718 to produce the stills or 
frames 1702 to 1712^ embodiments of the present invention 
are not limited to such an arrangement. Embodiments can 
be realised in which each of the stills or frames 1702 to 
1712 represent start and end frames for a scrolling 
25 operation and a number of frames are calculated and 
produced using the sliding window 1716 to give effect to a 
transition between any given pair of start and end frames. 
It will be appreciated that the smoothness , as perceived 
by the user^ of the scrolling between any given pair of 
30 start and end frames will be or, at least can be, 
significantly greater than corresponding scrolling using 
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the frames or stills 1702 to 1712 depending on the step 
si26 1718 selected* 

The above embodiment has been illustrated with 
reference to scrolling up and down through the dociimeAt 
5 1714 for the purpose of illustration only .and ' is 
- convenient given the type of text-based document to be 
scrolled through used to illustrate eiobodimerLts of the 
invention ♦ It will be appreciated that embodiments of the 
present invention are not limited to scrolling up and 
10 down. EmbQdiments can be realised in which scrolling is 
effected sideways^ that is,, left and right- It will be 
appreciated that such left and right scrolling might be 
appropriate when viewing a document, that is more properly 
represented horizontally such as a landscape document 

15 showing a panoramic view. Therefore , the scrolling data 
sets produced by embodiments of the present invention can 
also be arranged to produce left and right, or sideways, 
scrolling together with appropriate, scroll arrow graphics 
and navigation data either alone, in the case of a 

20 panoramic view or document having a single screen height, 
or in conjunction with the up and down scrolling menu 
graphics and corresponding navigation data in the case of 
a document that is both wider and higher than the 72 0x4 BO 
or 720x576 pixels of DVD NTSC and DVD PAL/SECAM pixel 

25 resolutions respectively. It will be appreciated that in 
the latter case, embodiments of the present invention 
produce 2-dimensional scrolling data sets and allow 2- 
dimensional scrolling to be realised. 

Figure 21 shows schematically the production 2100 of 
30 2-dimensional scrolling data sets. Figure 21 depicts an 
initial or original image document 2102, which is 
notionally divided into 9 regions 2104 to 2122 that can be 
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used to display respective parts of the overall image 
2102. Although the embodiment has bsen illustrated using 
9 regions, the present invsntion is not liTTiifc^d to suc-h ^r: 
arrangsment . Embodiments can be realised in which any 
5 predetermined number of regions is used. 

The visual assets r-eguired for vertical scrolling are 
produced in substantially the same manner as the stills or 
frames 1702 to 1712 were produced foe one-dimensional 
scrolling. it can be appreciated that a transition from 
"the central region 2102 to a central upper region 2120 has 
been shown as requiring the production of four stills or 
frames 2124 to 2130. The initial frame 2124 contains data 
corresponding to the data contained within the central 
portion 2102. The final frame 2130 of the transition 
15 . contains data corresponding to that contained within the 
upper central portion 2122 of the image 2102. The 
remaining frames 2126 and 2128 are produced according to a 
desired step size as a notional window (not shown) 
traverses the image 2102 from the initial position at the 
central portion 2120 to the final position of the upper 
central portion 2122. Again, it will be appreciated that 
the smoothness or resolution of the scrolling is governed 
by the step size. The smaller the step sise, the greater 
the number of visual assets that will be produced. 
25 Alternatively, as with the above embodiment, the four 
stills or frames 2124 to 2l30 might represent intermediate 
scrolling positions for an overall transition from the 
centrral portion 2120 to the upper central portion 2122. 
For each set of adjacent pairs of those intermediate 
positions such as, for example, positions 2126 and 2128^ a 
number of intermediate visual assets can be calculated. 
It will be appreciated that the flowcharts shown in 
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figures 19 and 20 are as applicable to vertical scrolling 
given an initial asset size that is wid^r than a desired 
asset si2^ as they were to figure 18 in which the desired 
asset siz^ vas the same width as the original asset. 

5 Figure 21 also illustrates the production of 

horizontal scrolling, data, sets - In the case of horizontal 
scrolling it can be appreciated,, again for the purpose of 
. illustration only, that the initial starting position is' 
shown as being the bottom central portion 2118 of the 
10 overall image 2102 and the end position is shown as being 
the- lower right portion 2116 of the overall image 2102. 
^ The illustrated five stills or frames 2132 to 2140 are 
produced using corresponding start positions 2142 to 2150 
. for. a notional window (not shown) as it progressively 
15 traverses the original asset 2102 according to a 
^ respective jstep size. Again^ it will be appreciated that 
the flowcharts showing figures 19 and 20 are equally 
. applicable to horizontal scrolling. However, in the 
flowchart 1900 shown in figure 19 the asset start and end 
20 positions are calculated using W rather than In 
flowchart 2000 shown in figure 20 1. the test performed at 
step 2010 is arranged to determine whether the left arrow 
of any scroll direction arrow graphics r presented as sub- 
picture menu items,, has been actuated rather than the 
25 scroll-up arrow. 

Referring to figure 22 there is illustrated a process 
2200 for producing sequence of video that emulates 
zooming, that is, that gives the impression to the use of 
the OV"D that they are controlling zoom-in and zoom-out 
30 functions. Figure 22 comprises a central image I that is 
notlonally divided into predetermined number of regions . 
In the illustrated example the image I has been divided 
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into 9 regions that are labelled A-1 to I-l. it will be 
appreciated that the central portion I-l is shown as being 
sub divided into 9 further notional regions, .a-? to 1-2. 
SUtiilarly each of the other first-level notional regions 
A-1 to H-1 can also be divided into 9 second-level 
notional regions A-1, a-2 to Al, i-2. Similarly, the 
central portion 1-2 of the first-level notional region I-l 
is also shovn as being sub divided into 9 third-level 
notional regions A-3 to 1-3. Again each of the other 
second-level notional regions A-2 to H-2 may alao be sub 
divided into 9 corresponding third-level notional regions. 



The levels of each of the notional regions are used to 
control zoom in and zoom out functions according to 
15 sflfibodimenta of the present invention. For example, 
enibodimenta can be arranged in which a video sequence is 
generated to reflect zooming between a view of the whole 
of the first-level image I and second-level view of that 
■ image I, which has reference numeral I-l. it will be 
appreciated such a video sec^uence, or, more accurately, 
such a pair of video sequences, would allow, zoom in and 
zoom out function to be realised to allow the user to view 
the whole of the first-level image I or a portion I-l of 
that image I. It can be appreciated that such a pair 2202 
25 and 2204 of the video sequences are illustrated. ' The 
first video sequence 2202 of the pair is shown as 
comprises four frames, that is, a start frame I an end 
frame I-l, and a pair 2206 and 2208 of intermediate 
frames. The data for the start frame I is derived from 
the whole of the initial or original document or image I. 
The data for the end frame I-l is derived from the central 
portion of the initial document I. The data for the 
intermediate frames 2206 and 2208 is derived from 
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respective transition regions 2210 and 2212 of the 
original document I respectively- It will be appreciated 
that the video sequence has been illustrated as comprising 
four frames for the purposes of illustration only. In 
5 practice, the video sequence 2202 might contain many more 
intermediate frames according to a desired level of 
smoothness of the zooming between start image I and the 
end image I-l. In a similar manner zooming between 
document vi'ew 1-1 and a further document view 1-2 is also 

10 shown as comprises a pair of transitional images 2214 and 
2216 these transitional image 2214 and 2216 are derived 
from respective transitional regions (not shown for the 
purpose of clarity) in a similar manner that the 
previously mentioned transition images 22 0 5 and 2208 were 

13 derived from corresponding transition regions 2210 and 
2212. Similarly a still further video sequence 2218" 
illustrating zooming between document views 1-2 and 1-3 
comprising respective transition images 2220 and 2222 is 
also illustrated as discussed previously, the number of 

20 transition image derived from respective transition 
regions^ can be set according to a desired smoothness of 
zooming. Therefore various video sequences can be 
generated at illustrate zooming between respective 
document views I^ I-l^ 1-2 and 1-3, for example, of the 

25 original document or image I. 

It will be appreciated that zooming image sequences 
between the various notional levels of document view can 
be generated for each of the notional regions. 



30 



Still further^ the above described 1-D and 2-D 
scrolling can also be used to generate image sequences for 
moving between the various notional regions. 
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Although the above embodiments have been described 
with reference to production of graphical er^ment.s 
representing arrows for controlling the zoom, embodiments 
5 are not limited to such an arrangement. Embodiments can 
be realised in which the scrolling or 20oming functions 
are controlled via the IR remote control without the need 
to select the sub-picture menu options presented in the 
form of arrows. In such embodiments, the scrolling 
10 function may be performed in response to actuation of 
selected keys^ such as, for example, up down and left 
right arrow keys that are provided on many IR remote 
controls. 



15 It Will be appreciated that the complexity of the 

links between the visual assets increases when stills or 
frames to suppoirt two-dimensional scrolling are authored. 
Rather than having, one average^ a pair of links per 
visual assets, each visual asset will have, on average, at 

20 least two pairs of links tp respective surrounding assets, 
assuming scrolling is limited to scrolling in two 
directions. However, it scrolling is supported in other 
directions, such as in NE-SW and/or NW^SE directions, the 
number of links to surrounding or successive assets will 
25 again be increased. 



Furthermore, although the above embodiments have 
illustrated using scrolling in mutually orthogonal 
directions NS and EW directions, they are not limited to 
such an arrangement. Embodiments can be realised in which 
30 scrolling in other mutually orthogonal directions can be 
implemented in addition to, or as an alternative to, the 
NS and EW scrolling. 
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The DVD authoring method and apparatus described above 
have a nujnber of advantages. Creating components that 
represent parameterized sections of audio visual content 
allow many individual AV assets to be implicitly defined 
5 and then automatically created. Bepetitive manual tasks 
are avoided, which were previously time consuming, 
expensive and error^prone. The authoring method and 
apparatus significantly enhance the range of features 
available in existing categories of audiovisual product 

10 such as movie presentations. They also allow new 
categories of audiovisual product to be produced. These 
new categories include both entertainment product such as 
quiz-abased games and puzzle-based games^ as well as 
information products such as catalogues^ directories, 

15 reference guides, dictionaries and encyclopaedias. In 
each case, the authoring method and apparatus described 
herein allow full use of the video and audio capabilities 
of DVD specifications such as OVD'-video. A user may 
achieve playback using a standard DVD player with ordinary 
20 controls such as a remote control device. A DVD-video 
product having highly complex navigational content is 
readily created in a manner which is siitiple, efficient, 
cost effective and reliable. 

25 Although a few preferred embodiments have been shown 

and described, it will be appreciated by those skilled in 
the art that various changes and modifications might be 
made without departing from the scope of the invention, a$ 
defined in the appended claims - 

30 

The audiovisual product comprises at least any one of 
data representing audiovisual content, DVD video disc 
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image data, other data compliant with the dvd 
specification or a medium storing such data. 

Although the above embodiments have been described 
with reference to the pz-oduct being playable by a' 
"standard DVD player", it will be appreciated that other 
players can equally^ well be accainmodated such as, for 
example, software player5, set-top boxes or other means of 
processing or otherwise rendering audiovisual content 
using hardware or software or a combination of hardware 
and software. 



The reader »s attention is directed to all papers and 
documents which are filed concurrently with or previous to 
15 this specification in connection with this application and 
which are open to public inspection with this 
specification, and the contents of all such papers and 
documents are incorporated herein by reference. 



All of the features disclosed in this specification 
(including any accompanying, claims, abstract and drawings) 
and/or all of the steps of any method or process so 
disclosed, may. be combined in any combination, except 
combinations vhere at least some of such features and/or 
steps are mutually, exclusive. 

25 Each feature disclosed in this specification 

(including any accompanying claims, abstract and drawings) 
may be replaced by alternative features serving the same, 
equivalent or similar purpose, unless expressly stated 
otherwise. Thus, unless expressly stated otherwise, each 
feature disclosed ia one example only of a generic series 
of equivalent or similar features. 
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The invention ±5 not restricted to the details of any 
foregoing embodiments. The invention extends to any novel 
onsr or any novel cofnbination^ of the features disclosed 
in this specification (including any accompanying claims 1 
abstract and drawings) ^ or to any novel on&^ or any novel 
Combination, of th6 steps of any method or process so 
disclosed. ■ 
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1- Atl authoring method for use .in r~..iroa.i---'r>r, 

— — — — — — iB-ijl 

I audiovisual product, comprising the steps of: 

5 

defining a plurality of components^ the components 
: implicitly representing" "functional sections of audiovisual 

content with respect to one or more raw content objects, 
and a plurality of transitions that represent movements 

j 10 between the plurality of components; 

i 

expanding the plurality of components and the 
; plurality of transitions to provide a set of explicitly 

realised Av assets (set of scrolling image data} and an 
expanded intermediate data structure of nodea and links 
15 (links to the set of scrolling image data and to images of 
each scrolling get - that is the video sequences within 
each set showing the scrolling) , where each node is 
a3SQciated with an AV asset of the set and the links 
I represent movement from one node to another; and 

creating an audiovisual product in a predetezroined 
output format, using the AV assets and the expanded 
intermediate data structure of the nodes and the links ^ 
wherein the audiovisual product comprises data to produce 
scrolling image data. 



20 



25 



2. The method of claim 1, wherein the defining step 

comprises defining at least one information component that 
comprises a reference to a raw content object. 

30 3. Th^ method of claim 2, wherein the reference 

denotes a file path to a location where the raw content 
object is stored. 
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4. The method of any preceding ciaimr wherein the 
defining step comprises defining at least one choice 
component comprising a reference to at least one raw 
content object, and at least one authoring parameter. 

5 

5, The method of claim 4, wherein the at least one 
authoring parameter is adapted to control a selection or 
modification of the at least one raw content object. 

10 6. The method of claim 4 or 5, wherein the at least 

one authoring parameter comprises a runtime variable 
available during playback of the audiovisual product • 

7. The method of claim 4, S or 6^ wherein the at 
15 least one authoring parameter comprises an authoring-only 

parameter that will not be available during playback of 
the audiovisual product. 

8. The method of any of claims 4 to 7, wherein the 
2 0 choice component comprises a reference to a presentation 

template and a reference to at least one substitutable raw 
content object to be placed in the template according to 
the at least one authoring parameter. 

25 9- The method of any preceding claim, wherein the 

defining step comprises defining at least one meta- 
component representing a set of components and 
tranaitions . 

30 10- The method of claim 9^ wherein the at least one 

meta-component is a. procedurally defined representation of 
the set of components and transitions . 
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11. The method of any preceding claim, wherein each 

'transition represents a permissible movement from one 

5 12- The method of any preceding claim^ wherein each 

transition is associated with a triggering event, 

13. The method of claim 12, wherein the triggering 
event is an event occurring during playback of the 

10 audiovisual product* 

14. The method Of claim 13/ whei-ein the triggering 
event is receiving a user command^, or e>£piry of a timer - 

15 15, The method of: any preceding claimy. further 

comprising the step of- checkihg expected conformance of 
the audiovisual product with the predetermined output 
format, using the plurality of components and ' the 
plurality of transitions'. 

20 

16. The method of claim 15, wherein the predetermined 

output format is a hierarchical data structure having 
limitations on a number of objects that may exist in the 
data structure at each level of the hierarchy, and the 
25 checking step comprises predicting an expected number of 
objects &t ^ level and coit^aring the expected number vith 
the limitations of the hierarchical data structure. 

17- The method of claim 15 or 16, wherein the checking 

30 step comprises predicting an expected total size of the 
audiovisual product, and comparing the expected total size 
against a storage capacity of a predetermined storage 
medium. 
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18. The method of any preceding .claim^ wherein the 

expanding step comprises, for each component, building one 
or more of the set of explicitly realised AV assets by 
5 reading and manipulating the one or more • raw content 
objects . 

19- The method of any preceding claim, wherein: 

10 the defining step comprises defining at least one 

choice component comprising a reference to a plurality of 
raw content objects arid at least one authoring parameter; 
and 

15 the buil^ding Step comprises t 

selecting one or more raw content objects from amongst 
the plurality of raw content objects using the at least 
one authoring parameter ? and 

20 

combining the selected raw content objects to fomt one 
of the AV assets - 

20. The method of claim 19, comprising repeating the 

25 selecting and combining steps to automatically build a 
plurality of the explicitly realised AV assets from the 
one of the component s. 



21. The method of any preceding claim, wherein the 

30 expanding step comprises; 



4. NOV. 2003 18:02 



HARRISON 60DDARD POO 

46 



NO, 996 P. 52 



creating from each Qne of the plurality of components 
one or more explicitly realised AV assets to provide tha 
set- o^ .AV assets.: 

creating the expanded intermediate data structure 
5 wherein each node represents one AV asset of the set; and 

creating a set of links between the nodes. 

22. The method of any preceding claim, wherein-, each 
transition is associated between first and second 

10 components, and creating the set of links comprises 
evaluating each transition to create ^one or more links, 
each of the links being between a node created from the 
first component and a node created from the second 
component , 

15 

23. The method of any preceding -claim, wherein the 
expanding step comprises evaluating at least one of the 
transitions to create exit logic associated with at least 
one first node, evaluating one of the components to create 

20 entry logic associated with at least one second node, and 
providing a link between the first and second nodes 
according to the entry logic and the exit logic ► 

24. The method of claim 23^ wherein at least one of 
25 the transitions is associated with a triggering event, and 

the e^qianding step comprises evaluating the triggering 
event to determine the exit logic associated with the at 
least first one node. 

30 25- The method of any preceding claim, further 

comprising the step of checking expected conformance of 
the audiovisual product with the predetermined output 
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format^ using the AV assets and the expanded intermediate 
data structure of nodes and links. 

26* The method of claim 25 ^ wherein the predetermined 

5 output format is a hierarchical data structure having 
limitations on a number of objects that may exist in the 
data structure at each level of the hierarchy, and the 
checking step comprises predicting an expected number of 
objects at a. level and comparing the expected number with 
iO the limitations of the hierarchical data structure. 

27. : The method of claim 26r wherein the checking step 
comprises predicting an expected total size of the 
audiovisual product, and comparing the expected total size 

15 against a storage capacity of a predetermined storage 
medium. 

28. The method of any preceding claim, wherein the AV 
assets have a data format specified according to the 

20 predetermined output format. 

29. The method of any preceding claim^ wherein the AV 
assets each have a data format according to the 
predetermined output format, whilst the raw content 

25 objects are not limited to a data format of the 
predetermined output format. 

30. The method of any preceding claim^ wherein the 
predetermined output format is a DVD-video specif ication. 

30 

31- The method of any preceding claim, wherein the AV 

assets each comprise a video object, zero or more audio 
objects, and zero or more sub-picture objects- 
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32- The method of any preceding claim^ wherein the AV 

assets e^ch comprise at: Xe^5i?t c^r^.^. vJ_d*=«o ohy^-Kit.y z~bto to 
eight audio objects, and zero to thirty- two aub-pictura 
5 object according to the DVD- video specif icat ion . 

33. The method of any preceding claim, wherein th^ 
creating step compriaes creating objects in a hierarchical 
data structure defined by the predetermined output format 

10 with objects at levels of the data structure^- according to 
the intermediate data structure, of nodes and links, and 
where the objects in the hierarchical data structure 
include objects derived from the explicitly realised AV 
assets. 

34. The method of any preceding claim, wherein th6 
predetermined output format is a En/D-vldeo specification 
and the creating : step comprises creating DVD-video 
structure locations from the nodes of the expanded 

20 intermediate data ' structure, placing the e^fplicdtly 
realised AV assets at the created structure locations^ and 
substituting the links of the expanded intermediate data . 
structure with explicit references to the DVD-video 
structure locations. 

25 

35. An authoring method for use in creating a DVD- 

video product, comprising the steps of: 

creating a plurality of components representing 
parameterised sections of audiovisual content, and a 
30 plurality of transitions representing movements between 
components/ 
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expanding the plurality of components and the 
plurality of transitions to provide a set of AV assets and 
an expanded data structure of nodes and links ^ where each 
node is associated with an AV asset of the set and the 
links represent movement from one node to another; and 

creating a DVD-video format data structure from the AV 
assets, using the nodes and links, 

wherein the DVD-video format data structure comprises data 
arranged to produce scrolling image data. 

36- The method of claim 35 or 36^ comprising creating 

at. least one information component comprising a reference 
to an item of AV content. 



.15 37. The method of claim 3S, comprising creating at 

least one choice component comprising a reference to at 
least one item of AV content;, and at least one parameter 
for modifying the item of AV content. 

20 39 • The method of claim. 37, wherein the choice 

component comprises a reference to a presentation template 
and a reference "to at least one item of substitutable 
content to be placed in the template according to the at 
least one parameter. 

25 

39- The. method of claim 37 or 38, wherein the choice 

component comprises at least one • runtime variable 
available during playback of an audiovisual product in a 
DVD player/ and at least one authoring parameter not 
30 available during playback, 
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40, Tha method of any of claims 35 to 39^ comprising 

creating at least one m&ta-coiaponent representing a set of 

5 41. The method of any of claims 35 to 40^ wherein each ' 

transition represents a permissible movement from one 
component to another component/ «ach transition being 
associated with a triggering event. 




10 42. The method of claim 41, wherein a triggering event 

includes receiving a user command^ or expiry of a timer - 

43. The method of any of claims 35 to 42, wherein the 
expanding step comprises: 

15 creating from each one of the plurality of components 

one or more AV assets to . provide the set of RV assets; 

creating the expanded data structure wherein each node 
represents one AV asset of the set; and 

creating a set of links between the nodes . 

20 

44, The method of claim 37 or any claim dependent 
thereon, wherein the expanding step comprises evaluating 
each choice component to create a plurality of AV assets 
according to each value of the at least one parameter - 

25 

45- The method of claim 44, wherein evaluating each 

choice component comprises creating entry logic associated 
with at least one node and/or evaluating at least one 
transition to create exit logic associated with at least 
30 one node, and providing a link between a pair of nodes 
according to the entry logic and the exit logic. 
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46- The method of any of claims 35 to 45^ comprising 
the st^p of checking expecttad conformance with the DVD- 
video format using the created components and transitions • 

47- The method of any of claims 35 to 40, comprising 
the step of checking expected conformance with the Dvd- 
video format using the set of AV assets and the expanded 
data structure of nodes and links. 

10 

48. An authoring method for use in creating an 

audiovisual product according to a DVD-video 
specification, comprising the steps of: 

generating a set of AV assets each comprising a video 
15 object,, zero or more audio objects and zero or more sub- 
picture objects, and an expanded data structure of nodes 
and links, where each node is associated with one AV asset 
of the set and the links represent navigational movement 
from one node to another f and 

20 

creating a DVD-video format data structure from the 
set of AV assets, using the nodes and links ; 

the method characterised by the steps of! 

25 

creating a plurality of components and a plurality of 
transitions r where a component implicitly defines a 
plurality of AV assets by referring tc a presentation 
template and to items of raw content substitutable in the 
30 presentation template, and the plurality of transitions 
represent navigational movements between components; and 
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expanding the plurality of components and the 
plurality of transitions to generate thfe s&t of AV assets 
and the expanded .data structure .of. nodes and JJ.nks... 
wherein the set of AV assets and the expanded data 
5 structure comprises data for producing, or at least 
emulating, scrolling image data. 

49. A method as claimed in any preceding claim 

comprising the step of: 

10 producing, from data representing a static visual 

asset, a set of visual assets in which each visual asset 
of the set comprises data unique to that asset and data 
common to that asset and at least one other visual asset 
of the set; each visual asset of the set having respective 

15 defined dimensions. 50- A method as claimed in claim 

49, in which the step of producing the set of visual 
assets comprises the step of: 

progressively traversing the static visual assets 
to copy data, from the static visual asset, to form 
20 respective visual assets of the set- 

51. A method as claimed in claim 50 in which the step 

of traversing comprises . the step of: 

defiXLixxg a predeterminable step size^ less than at 
least one of the respective defined dimensions^ and 
25 traversing the static visual asset according to that 
predeterminable step size » 52. A method as claimed in 

any of claim 4 9 to 51, further comprising the steps of: 

creating, for each visual asset In the set, 
associated asset display control data comprising data 
30 representing at least one selectable graphical element 
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and at least one link, associated with the selectable 
graphical element, to another visual asset of the set 
of visual assets. 

5 53. A data processing method as claimed in claim 52 f in 
which the step of creating comprises the step of: 

creating, for selected ox all vis-uai a$$ets of the set 
of visual assets, associated ^ asset display control data 
comprising data representing at least a pair of selectable 
10 graphical elements and data representing at least a pair 
of linkS/ associated with respective ones of the pair of 
selectable graphical elements, • to a preceding visual asset 
and a succesding visual asset of the set of visual assets. 

15 54 . A method as claimed in any of claims 49 to 53 in which 
at least one of the dimensions of the static visual asset . 
exceeds at least one of the defined dimensions of at least 
one of the visual assets of the set of visual assets . 

55, A method as claimed in claim 54, in which the 
20 dimensions of the static visual asset exceed two defined 

dimensions of at least one of the visual assets of the set 
of visual assets - 

56. A method as claimed in any of claims 49 to 55 in 
which the step of producing the set of visual assets 

23 comprises the step of: 

progressively traversing,, in at least two 
different directions^ the static visual asset to copy 
data, from the static visual asset/ to form respective 
visual assets of the aet. 
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57 . A data processing method as claim<sd in any claim 

5 6 in which the step of producing the set of visual assets 

r7.Qrrirj-rift A A til* ' • 

progressively tcaversing, in at least two 
5 orthogonal directions, the static visual asset to copy 
data, from the static visual asset, to form respective 
visual assets of the set. 

5S- A data processing system for authoring optical 

medium data comprising: 

• 10 means for producing, from data representing a 

static visual assets a set of visual assets in which each 
visual asset of th6 Sfet comprises data unique to that 
asset and data common to that asset and at least one other 
- visual asset of the set; each visual asset of the aet 
15 having respective defined dimensions. 

59. A data processing system as claimed in claim 58 in- 

which the means for producing the sfet of visual assets 
coraprises means for progressively traversing the static 
visual asset to copy data^ from the ^static visual asset/ 
■20 to form respective visual assets of th$ 3et- 

60. A data processing system as claimed in claim 59 in 
which the means for traversing comprises means £or 
definlng a prede terminable step size, less than at least 
one of the respective defined dimensions, and traversing: 

25 the static visual asset, according to that predeterminable 
step size. 

61, h data processing system as claimed in any of 
claims 58 to 60, further comprising 
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means for creating^ for each visual asset in the 
get, associated asset display control data comprising data 
representing at least one selectable graphical element and 
at least one link, associated with the selectable 
5 graphical element, to another visual asset of the set of 
visual assets - 

62. A data processing system as claimed in claim 61 In 

which the means for creating comprises : 

means for creating, for selected or all visual assets 
10 Qf the set of visual assets r associated asset display 
control data comprising data representing at least a pair 
of selectable graphical elements and data representing at 
least a pair of links, associated with respective ones of 
the pair of selectable graphical elements, to a preceding 
15 visual asset and a succeeding visual asset of the set of 
visual assets - 

63 . A data processing system as claimed in any of 
claims 58 to 62 in vhich at least one of the dimensions of 
the static visual asset exceeds at least one of the 

20 defined dimensions of at least one of the visual assets of 
the set of visual assets. 

64 . A data processing system as claimed in claim 63 in 
which the dimensions of the static visual asset exceed two 
defined dimensions of the visual assets of the set of 

25 visual assets. 

65. A data processing system as claimed in any of 
claims 58 to 64 in which the means for producing the set 
of visual assets comprises ' means for progressively 
traversing, in at least two different directions, the 
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static visual asset to copy data, from the static visual 
asset, to form respective visual assets of the set, 

66- A data processing system as claimed in claim 65 in 

which the means for prQd\iq:ing th^ set of visual assets 
5 comprises means for progressively traversing, in at least 
two orthogohal directions, the static visual asset to copy 
data, from the static visual asset/ to form respective 
visual assets of the set. 

67* A computer program comprising code for 

10 implementing a method or system as claimed ih any^ 
pre^sedlng claim. 

68, h computer program product comprising a computer 

readable medium storing a computer program as claimed in 
claim 67 . 

13 69. A method of manufacturing a DVD product; the 

method comprising the step creating a data carrier 
comprising data representing at least the set of visual 
assets created using a method/ system^ computer program or 
computer program product as claimed in any preceding 

20 claim. 70. A method of manufacturing a DVD product; the 
method comprising the steps of: reading a data carrier 
comprising data representing at least the set of visual 
assets created using a method or a system as claimed in 
any of claims 1 to 18; and materially producing the DVD 

25 product using the data stored on the data carrier. 

71. A DVD product comprising data representing a set 

of visual assets; the visual assets having been derived 
from a static visual asset such that at least a pair of 
30 successive visual assets of the set of visual assets 
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comprise respective unique data and data common to the 
pair of successive visual assets thereby allowing a 
scrolling effect to be emulated whea the pair of assets 
are successively displayed . 

5 72. A data processing method substantially as 

described herein with reference to and/or as illustrated 
in the accompanying drawings . 

73. A data processing system substantially as 

described herein with reference to and/or as illustrated 
10 in the accompany drawings - 

74 - A computer program product or element 

substantially as described herein with reference to and/or 
as illustrated in the ' accompanying drawings. • 

75. A method of manufacturing an optical data product 

15 substantially as described herein with reference to and/or 
as illustrated in the accompanying drawings - 

IS. An optical product or DVD product substantially as 

described herein with reference to and/or as illustrated 
in the accompanying drawings. 

20 77. A medium storing computer executable instructions 

for performing the method of any of claims 1 to 57. 

78, A medium storing an audiovisual product or 

associated data authored according. to the method of any of 
25 claims 1 to 57 . 
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^ ABSTRACT 

Data pirocessin? aysteza and me-bliocl 

An authoring method for creating an audiovisual 
product. The method has three main stages. The first stage 
defines components implicitly representing functional 
sections of audiovisual content and transitions that 
represent movements between components. The second stage 
expands the components and transitions to provide a set of 
explicitly realised AV assets and an expanded intermediate 
data structure of nodes- and links. Each node is associated 
with one of the AV assets and the links represent movement • 
15 from one node to another. The third stage * creates th$ 
audiovisual product in a predetermined output format^ 
using the AV assets and the expanded intermediate data 
structure of the nodes and the links^ wherein the 
audiovisual product comprises data to produce, or at least 
20 emulate,, scjfolling image data. ■ 
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